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ABSTRACT 


Peoectimemomrariltire rates can be present in an apparently 
homogeneous population of "devices" due to variability either 
in their manufacture or in the severity of their service en- 
weeonmentS. An initial mixing distribution is the probability 
Sot ribution for different failure rates in such a population. 
This distribution may be updated to yield its related residual 
femerne distribution, which is the probability distribution for 
different failure rates in the population of survivors after 
meeeceitied period of service or ‘'burn-in."' Residual mixing 
Seestrtbutions resulting from arbitrary mixtures of constant 
failure rates are shown to be stochastically ordered (decreas- 
gngly) as the period of service or burn-in is increased, and 
Bemaporoach in the limit a distribution degenerate at the 
eiatlest failure rate "present" in the population. Properties 
Semexpected value ordering, stochastic ordering, failure rate 
Ordering and likelihood ratio ordering are investigated to 
show that, of these, only likelihood ratio ordering between 
Evemiiiital mixing distributions is sufficient to guarantee 
ame Ordering between the expected values of their respective 


residual mixing distributions over time. 
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SUMMARY 


It is well-known that the failure rate function for 
arbitrary mixtures of exponential life distributions decreases 
erecime, approaching as a limit the smallest failure rate 
Peertively present in the mixture. 

Mt 1s. shown here that the sequence of residual mixing 
meoeribtitions which describes the distribution of failure 
rates present in the mixture ‘of survivors is not only decreas- 
mien expectation over time, but is also a stochastically 
decreasing sequence, degenerate in the limit at the smallest 
failure rate present in the mixture. Accordingly, for any 
particular value, the proportion of items present in the 
population of survivors having failure rates greater than 
that value decreases over time. This strengthens the notion 
that the shorter-lived members of the population are being 
"weeded out." 

Should it be possible to alter the initial distribution 
of failure rates present in the mixture, one would seek an 
alteration which would be better than the original mixture, 
iie@emwonly initially, but over time as well. A reasonable way 
to measure "'better'"' may be found in the failure rate function 
of the mixture. That is, one might seek an alteration to the 
G@riginal mixing distribution which would lead to a reduction 


tiie the mixture failure rate function over time. 





In seeking to find conditions on the alteration sufficient 
to guarantee the above-described improvement, several order- 
ings among the initial mixing distributions are considered. 
iiteveare, listing trom weakest to strongest, expected value 
Seaering, stochastic ordering, failure rate ordering, and 
Pikelihood ratio ordering. The results of this investigation 
show that, of the orderings considered, only likelihood ratio 
ordering is sufficient to guarantee the desired improvement. 

Likelihood ratio ordering is shown to be equivalent in the 
Semeiiuous case to distributions of Polya Type II. This result 
indicates that many of the more commonly encountered distribu- 
moms belong to this class, with the gamma distribution being 
a convenient and relevant example. Gamma mixtures of expo- 
nentials are employed in reliability evaluation for the 
Trident Missile program. 

feeis shown that, in an n-polnt discrete mixture, to 
achieve the desired improvement by shifting mass from one 
failure rate to a smaller one, the mass must be removed from 
the largest failure rate and added to the smallest failure 
face. In the use of this mixture to describe the procurement 
of items from n different sources, this result states that 
simply shifting mass from one source to a better one will lead 
to a mixture which will exhibit a lower initial failure rate, 
but a higher subsequent one. One must shift mass from the 
poorest source to the best source to prevent this subsequent 


crossover between mixture failure rates. 





I. INTRODUCTION 


A. BACKGROUND 

Mixtures of probability distributions have intuitive 
appeal in a number of diverse applications of probabilistic 
fteceis. Their use has spanned many years, dating back to 
before the turn of the century, for example, Karl Pearson's 
work in 1894 [l]. The breadth of their potential use was 
indicated by Feller [2] in saying that "every distribution 
may be represented as a mixture." 

As indicated by Blischke [3], two types of problems 
associated with mixtures of distributions have received much 
attention in the literature. They are the problems of identi- 
fiability and parameter estimation. 

The problem of identifiability is one of unique character- 
matron. As defined by Teicher in [4], for F = {F} a family 
Memaistributions, a w-mixture of F, say H, will be called 


identifiable if for any probability measure u*, the relationship 


50.9 ie Jrooance) = Propane) 


mmeres that W = w=. Other investigations into the identifi- 
Bbtiaty Of mixtures are given in [5], [6] and [7]. 

Given whatever assumptions one is willing to make concerning 
the families of distributions which may be involved in the 
mixture, the specifying parameters of those distributions must 


generally be estimated from sample information. Cohen and 





Falls [8] provide a good example of this sort of investigation. 
ijtey cxamine estimation procedures in a number of different 
mixtures, including mixtures of two Poissons, two exponentials, 
and two Weibulls. Their specific application is in the analy- 
sis of atmospheric data. Mixtures of binomials are examined 
mero) and [9], the latter with the field of advertising as 

an application. Parameter estimation for mixtures of expo- 
nentials is treated in [10] and [11]. 

This thesis treats general mixtures of exponentials. The 
recognition of such a mixture as a Laplace-Stieltjes transform 
guarantees its identifiability due to the uniqueness of deter- 
mining functions of such transforms as asserted in [12] and [2]. 
The purpose of this effort is to investigate the properties of 
such a model with emphasis on the interpretation and applica- 
milion Of results in the reliability context. 

The results in chapter II are essentially those reported 


Somiier by the author in [13]. 


eee JHE MODEL 


The model we shall consider is a mixture of the form 
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where F(t) is the survival function of the random variable T. 


SIME 


F(t;A) =e is the survival function of the component dis- 


tribution given that A = X for A a nonnegative random variable 
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having cumulative distribution function G. We can refer to 
mem a Mixture as a G-mixture of exponentials. 

We take the usual definition for a failure rate function 
as given in [14], i1.e., for the random variable T having 
density f(t) and survival function F(t), the failure rate 


mumetion h(t) is defined by 


teu) 
SCE SS MecOr eaitesuch Enat F(t) > 0. 
FiCe)) 





The initial mixing distribution G may be modified to yield 
mmeerated distribution indexed according to the value of t > 0, 
i.e., let GCA) = P(A < \|T > t) and define A(t) to be a random 


fieeraple having cumulative distribution function G,, which we 


t? 
meeoenize to be a conditional distribution for A, given that 
ioe t. The relationship between a mixing distribution G and 
MesecOorresponding distribution G, 1s given by a straightforward 
application of Bayes' Theorem which yields 


=A 
E(e 


we 
where the expectation is with respect to G, the distribution 
or i. 
We shall find it necessary to consider alternative mixing 
mandom Variables, for example, A, and Ao. We associate with 
each random variable A. esmceks 1 0U C LON G. ace les mecorre- 


sponding conditional distribution G. + as above. 
? 


des]: 





Me tie RELIABILITY PERSPECTIVE 

Mme mEc itr ye context for the expression (1.1), T 
mepresents the time to failure of an item drawn at random 
from a population of items having different exponential life 
Sestributions, mixed according to G, the distribution of A. 

The exponential distribution has been widely employed in 
modeling random lifetimes, due largely to its tractability 
mm@a@eto the fact that it 1s the limiting life distribution of 
complex equipment as the complexity and time of operation 
increase. The assumption for the latter result is essentially 
that the lifetime of the equipment is a superposition of many 
renewal processes [14]. 

The failure rate of such equipment may be considered to 
be related to both quality of manufacture and service environ- 
Geme [i5[. Thus, the consideration of both variability of 
manufacture and variability of service environment leads, 
individually and jointly, to the choice of a mixture of com- 
ponent distributions as the description of the life distri- 
bution of an item drawn at random from such a population. 
The use of the Stieltjes integral [12] admits continuous, 
Mmserete, Or mixed distributions G. 

Pre condabetonal distribution for A, given that T >t, Gi» 
mememe residual Mixing distribution at time t. It represents 
the revised distribution for the failure rate of an item 
randomly drawn from the mixture, given that the item is still 
functioning at time t. As an item continues to survive it 


admits a continual updating of the information at hand 


12 





concerning the mixture from which it was drawn. G, also 
represents the relevant mixing distribution for an item 
randomly drawn from the population of survivors at time t. 

For such a G-mixture of exponentials it is well known [16] 
mat the mixture failure rate h(t) is decreasing in t (we 
mah use ‘decreasing’ for non-increasing and 'increasing' for 
non-decreasing), and that the mixture failure rate approaches 
as a limit, with increasing time t, the least of all parameter 
mamues present in the mixture [17]. 

Aidrich and Morton [18] and O-Bar [19] showed that at time 
t the failure rate function of a G-mixture of exponentials is 
mmemexpected Value of the residual mixing distribution corre- 


ponding to that time, l.e., 
fer; 3) Geer = eul\iet ). |: 


mms, the sequence of residual mixing distributions is decreas- 
Pemerieexpectation. This fact Supports the intuitive notion 
meee with Increasing time the shorter-lived members of the 
mixture are being "weeded out." O'Bar [19] also showed that 
Beemeclope OL the mixture failure rate function over time is 
memaced to the variance of the residual mixing distribution 
by 

Ne Ge) Se eV R(t]. 


De EXAMPLES 
IPemiwOsbOint. Dascrete Mixture 
itmmacwmececm@tca tiie usamplest discrete case. Here, 


G is defined for Ay < ds by 


Ws 





A,» with probability p, 
A = 


X45, with probability P>: 


This could be thought of as a two-vendor situation, or a 
Single-vendor situation with two distinct service environments. 
meeaeveloped in [19], the mixture survival function is given 
by 

Ecc) SAP er She) 


' 
22 
oa 
= 


ee eee ee DS Ae PCT > t | A = 5) 


fmeemixture failure rate function is 


= ae zoe UC 
h(t) = f(t) _ P] 47° ae Pz Axe Z 
F(t) pe *1' + peem 2 


(1.4) 


(A, - hj,)t 


The conditional probability that the item was drawn from 
component distribution 1, given that it is still functioning 


at time t, Pp; (t), 1S given by 


Dy Cel = IPN SX | ae 
eee a t) jah = Ce eh = A5)) 


Pie ety) Pal) 


hat 
Pi 1 Py 


pe 1" + p,e "2 P} + Poe De 
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The conditional probability that the item was drawn 


from component distrihution 2, given survival to time t is 


pr(t) = 1 - p, @) = GS ee 


py (t) and .p,(t) emo rletmEnemneStaual mixing probabilities 
and can also be interpreted as the proportions of items with 
the component failure rates dy and d, Mmtnempopulation of 

Survivors at time t. The residual mixing distribution G, 1s 


then defined by 


A(t) 


| A,, with probability p, (t) 


do» with probability p,(t). 


Note that Pp, (0) = i) and p, (0) = po. As t increases, Pp, (t) 
increases from Py to 1 and Pp, (t) decreases from p, to OF 
2. Gamma Mixture 
This is a frequently cited continuous model, due 
primarily to its tractability. For example, see [15] and 


[20]. Here, A has the density 


& 
g(a) = risy Weeac? fon a, 6; X > 0. 


mae mixture survival function is 


15 








Meese Gh okt) = | eta (ayaa 
0 
> \ Bebe 5 OU y| 
0 [ (a) 
aes | (B+ ty" ,a-1,-(B + t)Ag, 
(B +t)? 0 (a) | 

= csi 
Pet) = lz =| 5 15 ee Ue 


The mixture failure rate function is given by 


ae) 
Ee) 


h(t) 
aS) 
OF 


> (eras 


ime) residual mixing density is 


eee re) 


F(t) 


g, 0) 





g + t7 go ,a-1i- (8 + t)a 
| B T (a) : 


(Gaon (8 = tA 
e ? 
r (a) 
which is itself a gamma density with parameters a and (8+t). 
It represents the density for the distribution of failure 
miees im the population of survivors at time t. The relation- 


Ship between G and G, Ieunismease 1S 
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A(t) = gEe A, 








‘that is, A(t) may be obtained from A by a change of scale. 


Wey 





Mime olLOCHASTIC ORDERING IN RESIDUAL MIXING DISTRIBUTIONS 


fee LNFTRODUCTION 

As mentioned in section I.C., the fact that the sequence 
of residual mixing distributions is decreasing in expectation 
leads to a conjecture of a compatible stochastic ordering of 
such a sequence. [In this section the existence of such a 
stochastic ordering is demonstrated. It is also shown that 
the residual mixing distributions converge in distribution to 
the distribution degenerate at the least parameter value 
Beertively present in the mixture, with an attendant monotone 
convergence of raw moments. The latter result 1s one asserted 
by Aldrich and Morton [18]. 

The results are presented as applications of Propositions 
2.1 and 2.2, to be developed in the next section. These propo- 
Sitions state properties of Efu[A(t)]} for fairly general 
functions u. To indicate the relevance of these propositions, 
we first note that an expression of this form is involved in 
(1.3), taking u[A(t)] = A(t). We next define an indicator 


mmc t10N 
fe. 1) I, (A) = 


Using this indicator function, G, may be expressed as 


ie 
ie. 2) GOA) = | leone E11, [ACC 
d 
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another expression of the same form, with uf[A(t)] = 


I, (ACt)]. 


Bee BASIC RESULTS 

We shail develop in Propositions 2.1 and 2.2 of this 
Section basic tools which should prove to be useful in a wide 
meerety Of applications. Several of these applications are 
maven in section [1I.C. 


Meame (1.2) we find that 


E{u(A(t)]} \ w (A) dG, (A) 


co -rt 
u(A)e 
\ a dG(A) 


(2.3) 0 E(e"*) 


AAS 


E(e At) 


mas, expectations of functions of A(t) may be evaluated by 
pmiply taking expectations of functions of A. A straight- 


forward application of the Monotone Convergence Theorem yields 


hue 


de fE{ucaye”“*}} = Bfucay He 8" 


2.4) 


Prnecinie «|. 


mon A > Q. 

We next require the function u_ to be nonnegative and 
memotone to get 
PROPOSITION 2.1. If A is a nonnegative random variable and 
u a nonnegative monotone increasing (decreasing) function, 


then 


see) 





-At 
6, (t) = ae E{u[A(t)]} 


is monotone decreasing (increasing) in t. 


mmgor: Using (2.4), 


a @ 4) - cme er | = Eluqhje “je(-te 8% 
dt u mee ie 


_ _ EfAucaye"“*y | Efucaje™"*y Ea) 


Bree gre SEs 


BeeGe lene ct) | Rik (e)ulA(e)] } 


COM Ne )ajaa(t) by. 


Then, by the property of the covariance of similarly/dissimi- 


larly ordered functions of the same random variable, 


A 
S 
© 
=) 
ar 


(i) u increasing in A(t) > 4 4,(t) < 
d 


V 
>) 


(ii) u decreasing in A(t) > ae o>, Ct) 2 


We now need two lemmas regarding limits of expectations 


involving time t as a parameter. 


LEMMA 2.1. Given u a nonnegative function, 


lim E[I, (A)ucaye 7408} 


t7><2 


maroot: Note that I. (A) = ]#A-2> peer Ny nt 0 eee oe 


An application of the Monotone Convergence Theorem yields 


-(A-A)t 


lim E[I, (A)u(Aje e> 0; (] 


C72 


20 





LEMMA 2.2. For i> A, = med CO 


Lim E[(1-1, (aye “2 *] > 0, 
too | 
teeor: Note that (1-1, (A)) =1oA - iA ay Sos ek ool 
for t>0. Then, E[(1-1,(A)je “4 > E[1-1,(A)] = GQ), 
TOANT) Ss gay > 0. 0 


ema lim lB [Cho 1 Ds 
C72 : 


iseeein adddition to the monotonicity requirement of 
meomposition 2.1, we also require u to be right-continuous 
at a> we may find the limiting value of o Ct) asaue > 
femeseace this result in 
BeOPOSITION 2.2. fet wieebe a2 NOnnecative random variable 
having cdf G, and u a nonnegative monotone increasing 
Meecreasing) function. If u is right-continuous at 
> = meiApG(A) <1}, then @ ,(t) decreases (increases) 


monotonically to u(r 9) ase Co, 


Proof: 
fee if u(A)t in A then o,,(%) 2 u(A,)-. Bee GODS lt Tem 


eae ae o,(t)+ ete eens 0 | im o,, (t) exists and lies in 


too 


the interval [u(A,) 5%). Choose A > ro: Then, 


5 E((1-1,(A))u(Aje"*] + EfI, (A)uCA)e "*y 
ae oo | =At. 
: E((1-1,(A))e"*] + BI, (Ae 8) 


Y 


E[ (1-1, (A))ucaye” #78) + BLT, CA)UCAye” MIF] 


Se Le es hr? ce ee 
E[(1-1,(a)je “4°-9I*) + ETT, cape OF 


> 


eimce ufA)+t in A, 


ZA 





wOVELC-1, (Ae OM] + BLT, A)ucaye OE) 


> errr (yt  .-. 2... (A-\)t, 
E[ (1-1, (aye 8] + BET, ye OME 


ult 


E[I, (A)u(Ajye IT 


u(A) + Serer yt) a Oe, (AHA) C 
E[(1-1,(A))je It} + Bf1, (ye YE 


[A 


(2), 
Lemmas 2.1 and 2.2 may be applied to show that the last term 
in expression (1) goes to zero as t>*+™. Therefore, 
lim atc) Sn eee tar ee Ae ee exeie Ihab > 60) < u(A,)- 


t7o tro 


then, ce) + u(r.) as) GF o, 


(ii) The proof for u monotone decreasing is similar to 


that above. tl 


fen PPLICATIONS 

The first application of the tools developed in the 
preceding section concerns the stochastic ordering of the 
sequence of residual mixing distributions and its limiting 


distribution, stated as 


Theorem 2.1. If A is a nonnegative random variable with cdf 
G and Ve iwc neem tinen t0m.a G-mixture of exponentials 
a) G, is a stochastically decreasing sequence in t, li.e., 


t, < t, as (A) > a Coro tor ali 


b) G, converges in distribution to the distribution 


degenerate at VEE aS et = ©; 
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mrmoot: 


We by 2s 2) 


G,Q) - en Ge) Iie 


Note that I, 1s monotone increasing in its argument. 
pplteamron or Proposition 2.1] with u[A(t)] = I, [A(t)] 
yields G, (A) + inp t 
Ppeerpplication of Proposition 2.2 with u[A(t)] = I. [A(t)] 
yields as t > o, 
0, do Ee, 
G.(A) + 1,Q,) = 
IL ee: (] 


This result strengthens the statements which can be made 
apout the population of survivors at time t. It was previ- 
ously known that {G,} 1S a sequence decreasing in expectation. 
Meme in addition we may see that, given any value ), the 
proportion of items in the population of survivors having a 
failure rate exceeding \ (indicated by G.0A)) is decreasing 
Mrecame. this relationship 1s clearly indicated in the 
meaples Of section I1.D. by the monotonicity of the residual 
Mixing probabilities in the two-point discrete mixture, and 
in the gamma mixture, by recalling that the relationship be- 


tween A and ite | ahs} 





A(t) = —S_ a. 


1 





then, for t., < t,, we have 








1 
x B+t, 
GO) Sener) = aN) 
oo k 
Bey age PLACES) >A] = pC) 


An immediate consequence of Proposition 2.2 is the well 
hewn result that a mixture of exponentials is DFR, with its 
failure rate approaching the least parameter value positively 


Meesent in the mixture. We state this result as 


Theorem 2.2. If A is a nonnegative random variable with cdf 
G and A, = inf{vA|G(A)<1}, then for a G-mixture of exponen- 
tials the mixture failure rate function, h(t), decreases 


monotonically to ro aS. tS. 


moot: As noted in (1.3), 
hice) = ealeiaGe) | . 


memitcatton of Proposition 2.2 with u[A(t)] = A(t) yields 
the desired result. J 
This result may be seen to hold in the examples of 
section I.D. by noting the expressions found for h(t) in 
ees) and (1.5). 
We may also see the monotone convergence for the raw 


moments of the residual mixing distribution in 


moecorem 2.3. For p > 0, E[A(t)?] decreases monotonically 


p 
to oe 
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feoor: Application of Proposation 242 with 


feeds the desired result. 


The variance of A(t) is of interest, 


u[A(t)] = A(t)? 


U 


Sinee lt nnas an 


mmeerpretation as the negative of the slope of the mixture 


mailure rate function [O'Bar, 


as 


Meeollary 1. The limit as t 


Proof: We express the variance of A(t) as 
2 2 
(2.5) cece ele) fy - EB [A(e)] 
itt, by Theorem 2.3, 
ee Ze 
lim VAR[A(t)] = et Mo = 0. 


Ct >a 


Expression (2.5) leads us 


Mumortary 2. On the interval 


Wwartation. 


Poot: From the power series 


for n a nonnegative integer. 


-At 
n Ip Ate 
E(e 
n! 
< 
t7E ( -At 


1s 


19i)-) We state the following 


to 


+o of VAR[A(t)] 


(0,°), VAR[A(t)] 


expansion for 


Thus 


At 
e 


Lo Zero 


is of bounded 


> 


we have that 





mien, £rom Expression (2.5) and Theorem 2.3, since VAR[A(t)] 
is expressed as the difference of two real-valued nonnegative 


monotone functions for t> Q, 


(0, ). 


LoMimoremDounGg@ed Variation on 


U 


26 





Pl wwe teow OvEkR LIME AMONG DISTINCT 
G-MIXTURES OF EXPONENTIALS 


fee LNTRODUCTION 

Chapter II dealt with the behavior over time of the 
sequence of residual mixing distributions iG, } corresponding 
jee single given mixing distribution G. 

ive applications of the model (1.1) in a reliability 
context prompt questions regarding orderings among distinct 
mieetal mixing distributions G; or the creation of some other 
such ordering between their corresponding residual mixing 
gost rabutions Os over time. Specifically, if the initial 
mixing distribution can be altered, what conditions upon the 
alteration can guarantee that the altered mixture would be in 


momensense better uniformly over time? This chapter contains 


some results in this direction. 


Pee BASIC RESULTS 
We examine several orderings, their properties and their 
micterrelationships in sections [II.B.1 through III.B.4. 
Wemeocochastic Ordering 
We take the usual definition for stochastic ordering 
as employed in Chapter II; that is, two random variables are 
Peochasticaliy ordered if and only if their survival functions 


Pecygibit that ordering, 


A, < A, = 6, Q) < G,(A), for all A. 


eel: 





Another useful characterization of stochastic order- 
ing states that Ay <** A, @ E[u(A,)] Ss E{u(A,)], £O0r all 
Eeemomotone increasing. This characterization follows directly 
from a lemma by Lehmann [21, p. 73] which states that 
if and only if there exist two monotone increasing 
mame tions fy and f., and a random variable V, with 
Meee < £,(v) for all v and A, =**£,(v), A, -**£,(¥). 

That Etu(A,)] S Efu(A,)] is a necessary condition follows 
from noting that Eftu(A,)]J = E{uf, (V)] < Efuf,(V)] = E{u(A,)]. 
That it is sufficient also may be seen by taking 

ee te X 


u(A) = I, (A) = 
Ore te ese he 
An equivalent characterization is A, <** a, @ E[u(A,)] 


E Efu(A,)], for all u monotone decreasing. 


feeedilure Rate Ordering 


We define a failure rate ordering between two random 


variables by 


say 
(1) Ay OPAL PEI yC4y0Ag) - Ty (4p AQ)] 2 0, 


mmeere £0r u > v the indicator function i - is defined by 


b] 


eee clin YD Vy 
ie 2 ) 


0, otherwise 
and where ES indicates an expected value with respect to 
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the product measure of A and A, for Ay and A, inde- 


pendent. We show the equivalence of the definition above and 


meordering of failure rate functions where they exist in 


Lemma 3.1. Given two random variables, A, and A, with 


failure rate functions hy and h, respectively, then 


7 hr 
h, (A) a h, (A) for all i oA, S A,. 


Proof: (>) Suppose hy) 2 h, (A) fon allow, 2 bnen, for 








ue Vv, 
u u 
| h,(s)ds E h,(s)ds 
V V 
mie u 
exp - h, (s)ds exp | h,(s)ds 
V V 
Bw tw 
G, ) a G,(v) 
G,(u)G, (v) - G,(v)G, (vu) 0 
P(A, > u)PCA, Sv) = P(A, > vV)P(A, Sb ee lt 
Ett ylAgeAy) . ee ee! 2 0 
(=) Reverse the above steps. i 
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* 


eer iakelinood Ratio Ordering 

Nemcice ei - moeeicehrnOOd Tat we Gndering between two 
random variables by Ay <°* A, @ Elo (M244) ze | Lor ‘all 
memetions > such that (x,y) = -¢(y,x), and (x,y) > 0 
mer X > y. 

This ordering is equivalent, in the case where the 
random variables have densities, to the assertion that A, 
and A. belong to a family of densities having monotone 
Meeeumood ratio [Zi]. Other characterizations of this 
ordering in the continuous case are given in [22] and [23]. 


These state that Ay and A, Seems oidecoube totally positive 
G@uporcer two, or Polya type Ii if and only if 


8,0 4) 8,04) 


Ih ue 
Fauivalently, that 
8, (Az) 8504) 
oe ——, , f Ns 


We show the equivalence of the definition given for 
Moxelihood ratio ordering and equation (3.3) in the continuous 


case in 


Lemma 3.2. Given two random variables, Ay and Ao; with 


densities 2) and g5 respectively, then 


50 





eye) 2, (A,) 
Mey = G50)” 11 * 42 2p fO 042.401 > 0, 


2 


mereai! functions ¢ such that o(x,y) = -¢(y,x) and $(x,y) > 0 


mon x > y. 


Proof: (>) E,[o(M,,4,)] | 6 (x,y) 85 (x) g, (y)dxdy 


y 
o(x,y) 85 (x) 8, (y) dxdy 
0 


0 


MA 


o(x,y)g,(x)g, (vy) dydx 
0 


o(x,¥)85(%) 8, (vy) dxdy 
y 


, 

| ; 
, ( 
I, 


Demmakxe changes of variables of x = v, y = u in the first 


mimepral and y = v, X = u in the second integral to get 


B,Lo(A5, Ay) I Scone g (0D neues 


‘ $(u,v)g,(u) g, (v)dudv 


HH) 


{{ o(u,v)g,(v)g, (vy) dudv 
| V 


: [ [ (u,v) g,(u)g, (v) dudv 
Oma 
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oe) oO 


ee zy | | o(u,v)[g,(u)g, (v) = g,(v)g, (u)] dudv 
OF Vv 


emcee U > v over the range of integration, the integrand is 


nonnegative by hypothesis and property two of the function ». 


Moe iet 0< 2, <z Choose Az such that 0 < Az < (z,-2,). 


1 oe 
Wowie = (2., Zz. + Az| for i= 1,2. Define 
i 1 it 
asi Ae 100 Ne I,, ae I, 
Oli sy) = On exe & I, ; ye I, 


0, otherwise 


The function o(A,,4,) iesnOwn anerhieure 3.1. 


\ 





18) AOE Es Sea Le 


2 





Then, Elo) Ay]) = P(A,eI,)P(A,e1,) - P(A,eT,)P(Ajel,) paa0:, 
which yields 


P(A,eI,)PQ,e!,) ; P(A,eT,)P(j,eI1,) 


> 
Az? ee = 


G,(z, + Az) - G,(z,) G, (z, + 42) - Gj, (24) 
Ne Nez, 


; G4 (2, + Az) - G,(z,) G,(z, + Az) - G, (z5) 


ez AZ 


MeteAz + 0 to get 85 (25) 8, (21) - §,(2,)8, (25) > 0, which 


mompletes the proof. fj 


4. Relationships Among Orderings 


Likelihood ratio ordering is the strongest of the 
three orderings. Its implication of failure rate ordering 


may be seen in 


Bema 3.5. A, <A 
Proof: Follows directly by defining 


Ee mete) La te X) 


Meeecne indicator function defined by (3.2), and noting that 
eesy) = -d(y,x) and o(x,y) > 0 for x > y. U 


That the reverse implication does not hold may be 
easily seen by letting n = 3, j = 2 and k = 3 in the counter- 


example of section III.C.2.a. 
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We get a direct verification of the well-known result 


mrit tailture rate ordering implies stochastic ordering in 


ple AL 
Lemma 3.4. A ‘S A, >A, = A,. 
leet: Follows directly by taking v = 0 in (3.1) (] 
Letting u(A) = A in the characterization for 


stochastically ordered random variables of section III.B.1. 
with respect to monotone increasing u yields the familiar 


mesult that 


st 
ee ee es ECA.) 


fee PLICATIONS TO MIXTURES OF EXPONENTIALS 
meeordering Inheritance Hypotheses 
We first formulate hypotheses asserting inheritance 
properties between orderings among initial mixing distributions 
and their respective residual mixing distributions. They may 
be stated as 


Bl E(A,) < E(A,) > E[A, (t)] ss E{A,(t)], came 


H2: A, <**A, >A, (t) <** A, (t), t > 


V 
© 


JA 


V 
© 


§ 4 § 7 
Boece = A(t) MO > ee 


H4: A, <A 


LA 
1 > f(t) < ~~ Aj (t), t > 


— 


V 
© 


Z 


We introduce the following set identifications: 


A= ((A,,4,) | E(A)) < EC,)} 


B= {(A,.A,) | ELA, (t)] < EfA,(t)], t > 0) 





memeC en) |X, <°"A5) 
Deco el fate) <A, (te), t > 0} 
Epoeamimpen,) | A, <®" A} 
ea@e ye) jn(e) < °° A(t), t > 0} 
ee SiGA) | A, <~"A,) 
Eee iCee) eee W(t), t > 0} 


We can now restate the hypotheses as 


Ree oe. B 
ieee: — D 
Hoe) E CF 
feos GC H 


fmemovse py Letting t > 0, that BC A, DCC and FCE. Thus, 
hypotheses H1-H3 are actually postulating equivalences. We 
also know from the relationships given in section III.B.4. 
Mrmeeo CEC CCAandHCFCODC B. 
meecounter-examples to Hypotheses 
a. Hypotheses Hl and H2 


We first state an additional hypothesis: 


Ss 1 ae ae GEE (el £ > 0. (CC B) 


ieom section I1I1.B.4. we know that Cs A and that DC B. If 


fmeeis false, then C Nn B is not empty. That would imply that 
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neither AN B nor cn Bis empty. Thus, hypotheses H1 and 
HZ would be disproved. 

HS5 is shown to be false as follows: Let A. = i. 
with probability p;, 1 = 1,...,n, where dy < A, <..<SA,. Then, 
mores jl < kK <n, let 


eaevlon prOobabilitty p. + € 


| J 
Ay = hy with probability Pp - € 
4; with probability p,, i # j,k 
By inspection, A, Sees: ecm nti, “the 1h, 2, 2..04,1} ; 
1 # j,k}. Then we can write, summing from 1 to n unless 
Otherwise noted, 
Hee ie 
meee) | > b(t) > ———— 
2 2 Sp.e Ast 
: Pp,r,e “i + Go. Daa) ne 52 (Py 7 c)r,e *k* 
E(A(t)] = hy(t) = —~ tt : 


Assume that ELA, (t)] & E[A,(t)]. Then we have 


Nas ees ae le 
peered = eel j - 1,e *k") p,r,e *i 
apes it + Geman a rp.e Nas 

1 


Here, h,(t) and h(t) are the failure rate functions for 
T, and T, respectively. 
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oe ype AK AGIT 

ae h,(t) 
(ey, ey Ms 

(3.4) —_  <J 


Taking the limit as t + » in expression (3.4), h,(t) al and 
according to Theorem 2.2, we have dj < Ay- Therefore, j = l 
moa necessary condition, that is, for j # 1, the assumption 
eivat E[A, (t) ] < E[A,(t)] leads to a contradiction. Then, 
hypotheses H1, H2 and H5 are false. 

b. Hypothesis H3 


We first state an additional hypothesis: 


Ho: A, < "a, > B[A,(t)] < E[A,(t)], t> 0. (ECB) 


1 


memmoccciOn II1T.B.4. we know that FC DC B. If H6 is false, 
then Ef B is not empty which implies that EN EF is not empty, 
Seoproving H3. 

TeetoesMowneteebe talse by taking k = n and j # 1 
in the counter-example of section [III.C.2.a. Using the 
definition (3.1), it is easily verified that A, < ®*A,. From 
that counter-example, however, we know that j = 1 is a neces- 


sary condition for B. Therefore, H6 is false, disproving H3. 


oe 





fey Proot of Hypothesis H4 


We can go heyond hypothesis H4 and show an equivalence 
between likelihood ratio orderings in the initial and residual 


mixing distributions in 


Meoposition 3.1. A < MA <> A,(t) 2 Geet. > 0. 

a 2 it = a _ 
Proof: (=>) From equation (2.3) we know that for a function 
Uu, 


E{u[a(t)]} = £ u (Aye **] 
E(e At) 
Similarly, 
E_{u[A,(t),A,(t)]} ee 
Mel Eula 1c = 


Choose a function ¢ such that o(x,y) = -¢(y,x) and o(x,y) > 0, 
meeex > y. Then 


E [o(A,,A,)e S41742)*y 
E fe ©1782) *) 


E(o(A9(t) Ay (t)]} 


EY, (A544) 
Ele NtAD)t, © 


o(x,yye O*YIt. Note that ¥, (x.y) = -¥, (yx) 


where vy, (x, Y) 
and v, (x,y) Pave Gone yo by hypothesis, then, 


Ln 
Bl, (As Ay] A,(t). 


| Vv 


0, and A, (t) 3 
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(=) E,{o (A(t) Ay (t)]} > 0 


E [o(Ao.A,)e A142) %y 
Ente “A1*42)"] 


LA 
Then, E,[o(A,.A,)] 2 0, and A, < 


\,- f] 

Wace tie proot Of Proposition 3.1, then, we have 
established that, of the orderings considered, only likelihood 
YTatio ordering between two initial mixing distributions is 
sufficient to guarantee an improvement in the mixture failure 
Mmeeemrunction fOr any time t > 0. This would seem to be an 
extremely strong requirement; however, according to Karlin [23], 
most of the more common distributions belong to this class. 


The gamma distribution, in particular, is a member. We can 


Sm@owethis by noting for the gamma distribution, for u > v, 


a-1,-8u 1 


all 
(u) _ -8(u- 
aoa GD eT. 


We note that this expression is increasing ina and 
decreasing in 8. So, whether we are changing a or 8, holding 
the other fixed, the result will be two distributions which 
are likelihood ratio ordered. To see that such an alteration 
Pod, in fact, lead to an ordering of the mixture failure 
rate function over time, recall expression (1.5) which 


showed 





alte) Frere: 
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4. Shifting Mass from One Population to Another 


A common situation is one in which an item which fails 
meeording to an exponential life distribution is obtained from 
Several sources or populations having different failure rates. 


The survival function for the mixture then becomes 


=e 164 
Rie) 7 = z 


for n populations, each having a failure rate ds and compris- 
ing a part of the mixture D;- An obvious way to improve the 
mixture would be to shift mass from one population to another 
having a lower failure rate. From the counter-example given 
in section [II.C.2.a, we know that in order to guarantee an 
improvement in the failure rate of the mixture uniformly over 
time (that is, for a shift from A 


to A we want E[A,(t)] 


2 le? 
a EfA,(t)], aol SIGPUbatroOn. receiving the increase in 
Meosemust be that one having the minimum failure rate. That 
is, shifting mass to the most reliable population in the 
mixture is a necessary condition. Likelihood ratio ordering 
among initial mixing distributions was shown in section 
mimeo, to be a sufficient condition for such a uniform 
improvement in the failure rate. 

Recall the statement of the example of section 
III.C.2.a. As noted above, we Know that j = 1. Through a 
procedure analagous to that in the proof of Lemma 3.2, using 
sums instead of integrals, it is easily seen that in this 
c fA 


case for Ay < we have, for i> Mm, 


ti 
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P(A, = A.) y P(A, = \5) 
= Sera. = \ ome 
P 1 Am No An? 


Suppose kK yn. Let m = k and i=n to get 


P(A, = iJ PL -€ Py P(A, = di) 
and Ay £1, Then k =n and shifting mass from the worst 


population to the best population is sufficient for an improve- 
ment in the failure rate of the mixture uniformly over time. 

We note here that the intuitively appealing approach 
of simply shifting mass from a poorer population to a better 
Saeewitl not lead to a lower mixture failure rate function 
Seeeearl time. Unless the shift is made from the worst to 
the best, there will be some time at which the two mixture 
failure rate functions will cross. 

vue lihnood Ratio Ordering of 1, and 5 

We show a likelihood ratio ordering among initial mix- 
ing distributions to imply a likelihood ratio ordering of the 
Opposite sense in the times to failure of the mixture, Ty and 


T,, agg 
Proposition 3.2. A, s< A, >T, 2 T,- 


Proof: Suppose Ay < A. Define the function 


xy(e ’'2 eo ee ea. ey ee 


MOSS 
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femmore that (x,y) = -d(y,x) and $¢(x,y) > 0 for x Ey. 0, 


1 


By hypothesis, E,(o(A,,A,)] Ele ewbiem. tor t. < t5, 


E,{AyAafe” O1*2 vag eerie 2°?) ])} > 0 
(Mer er tag. t (hee + Nats ) 
E,[A,A,e \°1"2 2°1°] > E,[A;A,e 1" ae | 
E(A,e "1"2)E(A,e°"2*2) > E(A,e "1*1)E(A,e°"2°2) 
-A ~A.t 


E(A,e 2) E(A,e1°2) 


ee oe ot ty, 
E(A,e"2°1) ~ E(A,e7"1*1) nee 


mice) £4, (t5) 
f(t, ) — cage ep Se, 


mat is, Ty 2 T,. (] 


See ican Residual Litetime Ordering 
The mean residual lifetime at time t corresponding 


moma adistribution F is 


Go) | F(x)dx = E(t-t/T>t). 
BC) ale 
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miTen , 


u(t) = | 


¢ 


~ 5s 


r Fy (4) 





So gs then u,(@) 


Slee 


JA 
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